Structuring the Unstructured Middle with Chunk Computing
نویسندگان
چکیده
Modern computing substrates like cloud computing clusters, massively multi-core processors, and generalpurpose GPUs offer a wealth of computing power with the caveat that programmers must carefully structure their programs to fit within various hardware and communication limits in order to get high performance. Unfortunately, modern abstractions expressly hide machine structure from the program and program structure from the machine, hindering automatic optimization. We introduce an alternative computing abstraction—a linked graph of finite-sized memory chunks—that explicitly exposes the size and structure of programs to the operating system. The chunk graph enables the operating system to use size and structure to optimize how programs are mapped onto complex machine structure.
منابع مشابه
On the Optimal Scheduling of Streaming Applications in Unstructured Meshes
Unstructured, chunk-based P2P streaming (TV and Video) systems are becoming popular and are subject of intense research. Chunk and peer selection strategies (or scheduling) are among the main driver of performance. This work presents the formal proof that there exist a distributed scheduling strategy which is able to distribute every chunk to all N peers in exactly ⌈log 2 (N)⌉+1 steps. Since th...
متن کاملPersonalized Structuring of Retrieved Items
People nowadays struggle with huge unstructured collections containing some important knowledge. Search engines were developed to allow an easy access to relevant information, however they themselves produce for many queries large (unstructured) result sets. We suggest to tackle this problem by structuring these result lists or even complete collections in a personalized way, i.e. as the user w...
متن کاملAn Efficient Design and Implementation of an MdbULPS in a Cloud-Computing Environment
Flexibly expanding the storage capacity required to process a large amount of rapidly increasing unstructured log data is difficult in a conventional computing environment. In addition, implementing a log processing system providing features that categorize and analyze unstructured log data is extremely difficult. To overcome such limitations, we propose and design a MongoDB-based unstructured ...
متن کاملStructuring Open Source Information to Support Intelligence Analysis
Open source information on the internet can contribute significantly to intelligence assessments. Unfortunately, this information is mostly unstructured text, and varies widely in accuracy, focus, and level of impartiality. Though such unstructured information may be organized for convenient review in information portals, it is difficult to visualize, link, consolidate, summarize, compare, fuse...
متن کاملA Dependable Cluster Based Topology in P2P Networks
Unstructured peer-to-peer network is a prevalent model in current P2P networks. In general, unstructured P2P model divides the sharing file into many chunks. A peer must search the positions before downloads a chunk. Since a peer does not know the global topology of the overlay network and the distributions of the wanted chunks, what he can do is flooding chunk queries without a proper order wh...
متن کامل